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PREFACE  AIM O  ACKNOWLEDGEMENTS 


This  report  outlines  the  results  of  research  in  the  application 
of  statistical  methods  and  computer  technology  to  real  property 
valuation  for  tax  assessment.  This  research  was  carried  out  by 
the  Assessment  Standards  Branch,  Ontario  Department  of  Munici¬ 
pal  Affairs,  and  a  very  early  version  of  some  of  the  work  in¬ 
volved  was  reported  in  Methodology  Section,  Multivariate  Analysis 
and  Residential  Property  Valuation  in  Ontario  (Toronto,  October 
1970)  . 

The  present  report  deals  only  with  the  valuation  of  single  fam¬ 
ily  residential  property.  This  is  not  meant  to  imply  that  the 
valuation  techniques  considered  are  restricted  to  residential 
valuations,  but  only  that  single  family  residential  property  was 
selected  as  a  convenient  point  of  departure,  and  work  has  not 
yet  progressed  beyond  this  stage. 

The  early  report  indicated  above  was  couched  in  what  we  now  re¬ 
gard  as  a  misleadingly  "technistic"  manner.  Consequently,  an 
attempt  has  been  made  to  couch  the  present  report  in  as  concrete 
and  straightforward  a  way  as  possible.  This  reflects  both  a 
hope  that  the  resulting  material  will  be  more  accessible  to  the 
general  valuation  reader,  and  a  growing  conviction  that  the  es¬ 
sential  elements  of  the  work  are  not  of  a  highly  technical  na¬ 
ture  . 

The  research  presented  in  the  report  was  conducted  under  the 
general  supervision  of  Angus  N.  MacKay,  Director,  Assessment 
Standards  Branch,  Ontario  Department  of  Municipal  Affairs.  With¬ 
out  his  enthusiasm  and  support  whatever  progress  has  been  made 
would  not  have  been  even  remotely  possible. 

Several  other  people  also  made  substantive  contributions  to  the 
research.  Gerry  Meredith,  formerly  Assessment  Commissioner, 
Ontario  County  Assessment  Region,  and  now  Assessment  Commission¬ 
er  Niagara  Assessment  Region,  Ontario  Department  of  Municipal 
Affairs,  provided  the  Oshawa  data  which  forms  the  empirical  ba¬ 
sis  of  the  report,  and  both  he  and  his  staff  offered  a  great 
deal  of  help  in  more  intangible  (and  more  important)  ways.  Steve 
Solway,  Management  Science  Branch,  Ontario  Treasury  Board  secre¬ 
tariat,  provided  critical  guidance  on  statistical  methods  and  on 
the  statistical  elements  of  computer  programs.  Bill  Yuille,  pro¬ 
gramming  consultant  to  the  Systems  Development  Branch,  Ontario 
Department  of  Municipal  Affairs,  took  great  pains  to  develop  a 
system  of  computer  programs  closely  suited  to  the  needs  of  valu¬ 
ation  research.  Finally,  Jim  Tait,  Valuation  Section,  Assessment 
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Standards  Branch,  Ontario  Department  of  Municipal  Affairs,  calm¬ 
ly  attended  to  much  of  the  detailed  work  associated  with  the 
analysis  of  data,  and  kept  the  inevitable  tangle  of  research  ad¬ 
ministration  in  consistently  good  order. 

As  in  any  work  of  this  sort,  many  other  people  made  important 
contributions  in  less  direct  ways.  In  its  early  stages  the  re¬ 
search  profited  from  the  advice  of  S.  D.  Khosla,  presently  with 
Statistics  Canada  in  Ottawa,  and  Leigh  Bailey  and  Gordon  Van 
Toen,  Computer  Services  Centre,  Government  of  Ontario.  The  re¬ 
search  also  benefited  a  great  deal  from  earlier  work  in  the  same 
field  by  Robert  Gustafson,  State  Board  of  Equalization,  Govern¬ 
ment  of  California,  and  William  Shenkel,  Department  of  Real  Es¬ 
tate,  University  of  Georgia,  and  Mr.  Gustafson  kindly  provided 
a  variety  of  documentation  on  his  work  with  statistical  valua¬ 
tion.  Last  (but  by  no  means  least) ,  staff  in  the  Assessment 
Standards  Branch  (especially  in  the  former  Methodology  Section) , 
and  field  assessors  in  several  Regional  Offices,  Ontario  Depart¬ 
ment  of  Municipal  Affairs,  provided  no  end  of  stimulating  crit¬ 
icism  and  useful  advice. 


Randy  White  and  David  Montgomery 


Valuation  Section 
Assessment  Standards  Branch 
Assessment  Division 

Ontario  Department  of  Municipal  Affairs 
Toronto,  Ontario 


March,  1972. 


PRINCIPLES  OF  THE  COMPARATIVE  SALES  METHOD 

FOR  MASS  APPRAISAL 


In  the  last  five  years  a  substantial  amount  of  research  has 
been  undertaken  into  the  use  of  computer  technology ,  stati¬ 
stical  methods,  and  market  data  to  produce  real  estate  val¬ 
uations  for  property  tax  assessment . ^ *  For  the  most  part 
this  work  has  tended  to  treat  statistical  analysis  of  mar¬ 
ket  data  as  a  mathematical  exercise  for  computer,  rather 
than  as  a  valuation  exercise  rooted  in  principles  recogniz¬ 
ed  by  conventional  appraisal  theory.  Consequently,  although 
the  statistical  and  computer  components  of  the  valuation 
methods  presented  in  this  report  are  important  in  themselves, 
we  feel  that  their  ultimate  success  depends  on  the  skill  with 
which  they  are  integrated  into  traditional  comparative  sales 
methods  of  valuation. 

To  clarify  the  relationship  between  traditional  and  mass  ap¬ 
praisal  methods,  the  report  begins  by  outlining  each  method 
in  turn.  The  purpose  of  these  outlines  is  to  identify  the 
major  differences  and  similarities  between  the  two  methods, 
and  to  set  out  the  basic  principles  behind  our  adaptation  of 
the  comparative  sales  method  for  m^ss  appraisal  (or  "mass 
market  approach") .  The  report  then  illustrates  these  prin¬ 
ciples  with  reference  to  a  study  of  single  family  dwellings 
in  the  City  of  Oshawa . 


THE  TRADITIONAL  COMPARATIVE  SALES  METHOD 

Traditionally  the  comparative  sales  or  market  approach  to  real 
property  valuation  involves  "the  application  of  adjustment  fac¬ 
tors  to  comparable  sales  in  order  to  establish  a  value  for  the 
subject  property".^*  This  procedure  rests  on  a  specific  con¬ 
ception  of  property  value,  and  a  basic  assumption  about  how  val¬ 
ue  is  "set"  by  real  property  markets. 


Conception  of  Property  Value.  For  the  traditional  market  ap¬ 
proach  property  value  is  a  result  of  decisions  made  by  buyers 
and  sellers  of  real  estate.  These  decisions  are  reflected  in 
the  prices  at  which  properties  exchange  on  real  estate  markets. ^ 
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Assumption  of  Identical  Prices.  The  traditional  market  ap¬ 
proach  assumes  that  at  a  given  time  and  place  identical  prop¬ 
erties  will  tend  to  sell  for  identical  prices.  In  the  nature 
of  things,  "imperfections"  in  real  property  markets  create 
some  variation  in  the  prices  of  virtually  identical  properties. 
Consequently,  certain  authorities  prefer  to  talk  about  similar 
properties  that  sell  within  a  range  of  similar  prices. 5  Regard¬ 
less  of  how  the  assumption  is  cast,  its  implications  for  the 
mechanics  of  the  traditional  market  approach  are  the  same.  The 
way  to  estimate  market  value  for  an  unsold  property  is  to  ana¬ 
lyse  the  prices  of  similar  properties  that  have  sold  in  the  re¬ 
cent  past. 


Comparable  Properties.  The  first  major  step  in  the  traditional 
market  approach  involves  collecting  several  recent  sales  of 
properties  that  are  similar  or  "comparable"  to  the  unsold, 
"subject"  property  being  valued.  The  mechanics  of  this  step 
imply  that  properties  are  comparable  if  they  are  similar  with 
respect  to  characteristics  which  have  an  important  influence  on 
value. 6  Recognized  authorities  disagree  about  the  relative  im¬ 
portance  of  different  property  characteristics  in  specific  cases. 
All  authorities,  however,  pay  at  least  lip  service  to  the  view 
that  accurate  judgements  require  "diligent  market  research". 7 


Price  Adjustments.  The  second  major  step  in  the  traditional 
market  approach  involves  adjusting  the  prices  of  comparable  sales 
to  allow  for  important  differences  between  subject  and  compar¬ 
able  properties,  or  to  reflect  what  comparable  properties  would 
have  sold  for  if  they  were  virtually  identical  to  the  subject 
property  being  valued.  Once  this  has  been  done,  the  market  val¬ 
ue  of  the  subject  property  in  question  is  estimated  by  devising 
some  form  of  average  adjusted  price  for  comparable  sales. 8  Al¬ 
though  different  authorities  recommend  different  procedures  for 
making  price  adjustments,  all  procedures  depend  a  great  deal  on 
intuitive  knowledge  of  local  market  data. 9  Along  with  obvious 
constraints  associated  with  time,  this  lack  of  systematic  pro¬ 
cedure  in  the  traditional  market  approach  makes  it  highly  un¬ 
suited  to  the  requirements  of  mass  appraisal. 
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AW  AVAPTATION  FOR  MASS  APPRAISAL 


As  presented  in  this  report,  the  market  approach  in  mass  ap¬ 
praisal  estimates  the  market  value  or  most  likely  sale  price 
of  unsold  properties,  by  establishing  relationships  between 
sale  price  and  property  characteristics  for  roughly  similar 
properties  that  have  sold  in  the  recent  past.  Like  the  tra¬ 
ditional  market  approach,  this  "mass  market  approach"  rests 
on  a  specific  conception  of  property  value,  and  a  basic  as¬ 
sumption  about  how  value  is  "set"  by  real  property  markets. 


Conception  of  Property  Value.  For  the  mass  market  approach, 
as  for  the  traditional  market  approach,  property  value  is  a 
result  of  decisions  by  buyers  and  sellers  of  real  estate. 
From  the  standpoint  of  basic  principles,  the  mass  market  ap¬ 
proach  is  identical  to  the  market  approach  described  in  con¬ 
ventional  appraisal  literature. 


Assumption  of  Regular  Relationships.  The  mass  market  approach 
assumes  that  at  a  given  time  and  place  relationships  be¬ 
tween  sale  price  and  important  property  characteristics  are 
highly  regular  within  broad  groups  of  roughly  similar  proper¬ 
ties.  For  example,  at  a  given  time  and  place  a  study  of  mar¬ 
ket  data  for  a  certain  group  of  single  family  properties 
might  indicate  that  a  100  square  foot  increase  in  floor  area 
is  regularly  associated  with  a  $1000  increase  in  sale  price, 
while  a  ten  year  increase  in  the  age  of  the  house  is  regu¬ 
larly  associated  with  a  $2000  decrease  in  sale  price. 

The  assumption  of  regular  relationships  in  the  mass  market 
approach  might  be  treated  as  an  attempt  to  extend  the  assump¬ 
tion  of  identical  prices  in  the  traditional  market  approach. 

As  with  the  traditional  market  approach,  imperfections  in 
real  property  markets  create  some  degree  of  irregularity  in 
relationships  between  property  character istics  and  sale  price. 
It  might  be  more  realistic,  for  example,  to  say  that  within 
broad  property  groups  relationships  between  sale  price  and 
property  characteristics  are  at  least  regular  enough  to  permit 
acceptable  estimates  of  market  value  for  roughly  similar  prop¬ 
erties  that  have  not  sold.  Regardless  of  how  the  assumption 
is  cast,  its  implications  for  the  mechanics  of  the  mass  mar¬ 
ket  approach  are  the  same.  The  way  to  estimate  market  value 
for  a  group  of  unsold  properties  is  to  establish  relation¬ 
ships  between  sale  price  and  property  characteristics  for 
roughly  similar  properties  that  have  sold  in  the  recent  past. 
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Property  Groups .  The  first  major  step  in  the  mass  market  ap¬ 
proach  involves  dividing  all  sales  from  some  recent  time  peri¬ 
od  into  several  groups  of  roughly  similar  properties .  in 
principle  this  step  parallels  the  selection  of  comparable 
sales  in  the  traditional  market  approach,  although  in  practice 
the  procedures  involved  are  somewhat  different.  In  the  mass 
market  approach  the  purpose  of  the  step  is  to  isolate  groups 
of  properties  within  which  relationships  between  sale  price 
and  property  characteristics  are  as  regular  as  possible. 

The  construction  of  property  groups  is  constrained  by  one  major 
consideration.  As  a  general  rule  of  thumb,  each  group  must  in¬ 
clude  approximately  100  sales.  This  requirement  is  designed  to 
ensure  that  relationships  between  sale  price  and  property  char¬ 
acteristics  established  for  each  group  can  be  reliably  applied 
to  properties  that  have  not  sold. As  a  result  of  this  rule 
of  thumb,  the  number  of  groups  which  can  be  constructed  for  a 
given  time  and  place  depends  on  the  number  of  sales  available. 
Similarly,  to  the  extent  that  only  small  numbers  of  sales  are 
available,  relationships  between  sale  price  and  property  char¬ 
acteristics  within  each  group  are  likely  to  be  less  regular  than 
where  the  number  of  sales  is  large. 


Valuation  Models.  The  second  major  step  in  the  mass  market  ap¬ 
proach  involves  establishing  relationships  between  sale  price 
and  property  characteristics  for  each  group  of  roughly  similar 
properties.  Taken  together,  the  relationships  for  a  given 
group  form  a  "valuation  model". 

Valuation  models  can  be  treated  as  loosely  analogous  to  the 
price  adjustments  associated  with  the  traditional  market  ap¬ 
proach,  although  as  in  the  case  of  property  groups  the  actual 
procedures  involved  are  somewhat  different.  In  the  mass  mar¬ 
ket  approach,  for  example,  valuation  models  are  constructed  us¬ 
ing  a  statistical  technique  known  as  "stepwise  multiple  regres¬ 
sion  analysis ".  12  Roughly  speaking  this  technique  serves  two 
major  purposes.  First,  for  a  given  property  group  it  selects 
only  those  property  characteristics  that  are  significant  for 
estimating  market  value.  Second,  for  each  significant  char¬ 
acteristic  regression  analysis  indicates  a  "weight",  which  as¬ 
signs  a  dollar  value  to  the  relationship  between  sale  price 
and  the  property  characteristic  in  question. 
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PRACTICE  OF  THE  COMPARATIVE  SALES  IV1ETHOO 

FOR  MASS  APPRAISAL 


The  principles  of  the  mass  market  approach  can  be  clarified 
by  illustrating  how  they  are  used  in  actual  practice.  To  this 
end,  the  report  outlines  the  development  of  residential  valua¬ 
tion  models  for  the  City  of  Oshawa  (1970  population:  87,378) 
using  sales  data  from  the  calendar  year  1969.  It  is  worth  em¬ 
phasizing  that  although  the  mass  market  approach  can  be  applied 
at  any  time  and  place,  the  particular  results  presented  here 
apply  only  to  Oshawa  in  1969.13 


As  general  background,  in  the  City  of  Oshawa,  there  were  1553 
"valid"  sales  of  single  family  residential  property  during 
1969,  of  which  1506  sales  were  ultimately  used  to  develop  val¬ 
uation  models. 14  por  each  sale,  information  was  collected  on 
sale  price  and  37  property  characteristics,  which  were  hypo¬ 
thesized  as  having  an  important  influence  on  value. 1D  Infor¬ 
mation  on  6  property  characteristics  was  also  collected  for  all 
properties  in  Oshawa,  to  explore  the  extent  to  which  sold  prop¬ 
erties  represent  properties  that  have  not  sold.l^ 


PROPERTY  GROUPS 

All  1506  single  family  sales  in  Oshawa  were  ultimately  divid¬ 
ed  into  10  groups  of  roughly  comparable  properties,  as  indi¬ 
cated  in  Figure  1.  These  property  groups  were  constructed 
using  simple  classifications  of  data,  special  statistical  tech¬ 
niques,-^  first  hand  field  inspection,  and  trial  and  error  at¬ 
tempts  to  construct  valuation  models. 


Grouping  Characteristics.  As  outlined  in  Figure  1,  initial 
analysis  of  all  sales  data  almost  immediately  indicated  that 
whether  a  house  is  completely  detached  or  semi-detached  has  an 
important  influence  both  on  value  and  on  all  other  property 
characteristics.  Consequently,  semi-detached  was  identified 
as  a  "grouping  characteristic",  and  a  separate  property  group 
was  constructed  for  all  324  sales  of  semi-detached  houses. -*-3 
Analysis  of  the  remaining  1182  sales  of  detached  houses  then 
led  to  the  identification  of  two  grouping  characteristics  for 
sales  of  detached  single  family  properties  in  Oshawa  in  1969. 
The  first  is  building  age,  and  the  second  building  size  (floor 
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area)  . 


These  grouping  characteristics  meet  two  criteria.  First,  ac¬ 
cording  to  statistical  tests,  for  all  detached  sales  taken  to¬ 
gether  building  size  and  building  age  are  closely  associated 
with  sale  price.  Second,  on  a  similar  basis,  building  size 
and  building  age  are  also  closely  associated  with  all  other 
property  characteristics.  For  example,  large  houses  are  more 
likely  than  small  houses  to  have  more  bedrooms  and  bathrooms, 
to  be  located  in  "better"  neighbourhoods,  or  to  be  placed  on 
larger  lots. 


Construction  of  Groups.  Figure  1  indicates  that  in  addition 
to  a  distinct  property  group  for  semi-detached  houses  (Group 
10) ,  9  groups  were  constructed  for  detached  houses  on  the  ba¬ 
sis  of  variations  in  building  size  and  building  age  (Groups 
1-9) .  Roughly  speaking,  this  was  done  by  dividing  all  1182 
sales  of  detached  houses  into  three  broad  classes  of  building 
age  (Periods  I,  II,  and  III),  and  then  subdividing  these 
classes  according  to  building  size  (Small,  Large,  and  in  one 
case.  Middle  Size). 

Decisions  about  appropriate  breaking  points  for  these  property 
groups  -  or  answers  to  questions  like  "why  divide  at  1931 
rather  than  1925  or  1936?"  -  are  ultimately  systematic  judge¬ 
ments,  based  on  various  statistical  tests,  trial  and  error  at¬ 
tempts  to  develop  valuation  models,  and  a  general  knowledge  of 
available  market  data.  As  noted  earlier,  this  identification 
of  breaking  points  is  designed  to  isolate  property  groups  with¬ 
in  which  relationships  between  sale  price  and  property  charac¬ 
teristics  are  as  regular  as  possible. 


VALUATION  MOVELS 

Figure  2  sets  out  a  separate  valuation  model  for  each  of  the 
10  property  groups  identified  in  Figure  1.  It  is  important 
to  note  that  most  property  groups  involve  certain  minor  spec¬ 
ifications,  associated  with  characteristics  other  than  semi 
detached,  building  size,  and  building  age.  These  specifi¬ 
cations  are  designed  to  avoid  problems  of  "representation", 
as  indicated  later. 

Each  model  in  Figure  2  is  designed  to  estimate  market  value 
for  unsold  properties  from  the  same  group.  To  illustrate, 
the  valuation  model  for  Group  1  indicates  that  estimated  mar- 
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ket  value  for  an  unsold,  small  detached  house  in  Period  I 
is  $8800  +  $9.25  X  Floor  Area  -  $60  X  Building  Age  +  $125  X 
Date  of  Sale  (in  months)  -  $1300  if  Wood  Frame  +  $800  if  in 
Neighbourhood  6.  Consequently,  assuming  that  the  "date  of 
valuation"  is  December  1969,  if  the  unsold  property  in  ques¬ 
tion  has  a  1000  square  foot  floor  area,  is  50  years  old, 
solid  brick,  and  in  Neighbourhood  5,  estimated  market  value 
is  $8800  +  $9.25  X  1000  -  $60  X  50  +  $125  X  12  =  $16,550. 


Construction  of  Models.  The  valuation  models  set  out  in  Fig- 
ure  1  were  constructed  using  a  computer  program  which  incorp¬ 
orates  the  "stepwise  multiple  regression"  technique  referred 
to  earlier.  As  already  indicated,  this  technique  serves  two 
major  purposes.  For  example,  for  properties  in  Group  3  the 
computer  program  indicates  that  of  all  the  property  character¬ 
istics  for  which  data  was  collected,  only  floor  area,  building 
age,  date  of  sale,  site  frontage,  and  wood  frame  are  signifi¬ 
cant  for  estimating  market  value.  It  also  indicates  that  the 
market  value  of  unsold  properties  in  Group  3  can  be  estimated 
by  applying  the  following  set  of  weights  for  significant  char¬ 
acteristics:  $8400  +  $10.45  X  Floor  Area  -  $200  X  Building  Age 
+  $230  X  Date  of  Sale  (in  months)  +  $50  X  Site  Frontage  -  $1900 
if  Wood  Frame. 

Figure  2  indicates  that  different  property  characteristics  and 
different  weights  are  associated  with  valuation  models  for  dif¬ 
ferent  property  groups.  For  example,  Site  frontage  is  an  im¬ 
portant  characteristic  for  Groups  2, 3, 4, 5, 7, 8,  and  9,  but  not 
for  Groups  1,6,  and  10.  Similarly,  the  weight  for  building  age 
in  the  model  associated  with  Group  5  is  -$475,  while  the  weight 
for  building  age  in  the  model  associated  with  Group  1  is  only 
-$60.  This  seems  compatible  with  the  conventional  appraisal 
view  that  different  property  characteristics  have  cjl^fferent  in¬ 
fluences  on  value  for  different  kinds  of  property. 


Special  Problems.  The  construction  of  valuation  models  raises 
two  special  kinds  of  problem.  Thorough  discussion  of  these 
problems  is  beyond  the  scope  of  this  report,  and  we  will  simply 
indicate  what  they  involve  in  a  general  way. 

The  first  problem  concerns  the  issue  of  representation.  To  pro¬ 
duce  reliable  value  estimates  for  unsold  properties,  the  mass 
market  approach  must  obviously  ensure  that  valuation  models  are 
based  on  groups  of  sold  properties  that  adequately  represent  the 
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range  of  unsold  properties  to  be  valued.  In  slightly  different 
language,  it  is  at  least  risky  to  apply  valuation  models  to 
kinds  of  unsold  property  that  are  not  adequately  represented 
by  recent  sales. 

Representation  is  a  difficult  problem  which  might  be  impossible 
to  resolve  in  a  convincing  way.  Nonetheless,  in  recognition  of 
its  importance,  21  of  the  original  1553  "valid"  sales  of  single 
family  property  in  Oshawa  were  excluded  from  the  data  used  to 
develop  valuation  models,  since  they  involved  highly  "unusual" 
kinds  of  property. 20  This  means  that  the  valuation  models  set 
out  in  Figure  2  cover  about  98%  of  all  single  family  property 
in  Oshawa.  The  remaining  2%  of  single  family  property  require 
procedures  that  offer  greater  scope  for  individual  judgement. 21 


The  second  problem  involves  the  theoretical  assumptions  associat¬ 
ed  with  various  statistical  techniques.  Since  a  detailed  treat¬ 
ment  of  this  question  would  involve  technical  questions  far  re¬ 
moved  from  assessment  practice,  we  will  simply  note  that  the  val¬ 
uation  models  in  Figure  2  attempt  to  make  some  allowance  for  this 
special  kind  of  problem. 22 


ACCURACY  TESTS  OF  VALUATION  MOVELS 

Figure  3  sets  out  various  "test  data"  for  each  of  the  valuation 
models  outlined  in  Figure  2.  These  tests  are  designed  to  indi¬ 
cate  how  well  the  valuation  models  estimate  market  value  when 
compared  with  actual  sale  prices.  The  reasoning  behind  the  tests 
is  that  if  market  value  is  "most  likely  sale  price",  then  value 
estimates  are  "accurate"  to  the  extent  that  they  correspond 
closely  to  the  actual  prices  of  recently  sold  properties,  and 
"inaccurate"  to  the  extent  that  they  do  not. 


Tests  and  Time.  The  tests  set  out  in  Figure  3  are  based  on  the 
1506  sales  that  were  used  to  develop  the  valuation  models  out¬ 
lined  in  Figure  2.  These  tests  attempt  to  measure  the  extent 
to  which  the  10  valuation  models  "reproduce"  the  behavior  of 
single  family  property  markets  in  Oshawa  during  1969. 

It  is  also  possible,  of  course,  to  test  valuation  models  based 
on  one  year's  sales  data  using  data  from  some  subsequent  time 
period.  This  procedure  was  not  practicable  in  the  case  of  the 
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Oshawa  study  presented  here,  since  at  the  time  of  data  collection 
single  family  sales  for  the  time  periods  after  1969  were  not  read 
ily  available. 

Testing  against  data  from  some  subsequent  time  period  is  some¬ 
times  thought  to  be  more  reliable  than  testing  against  the  same 
year's  data,  since  it  avoids  using  the  same  sales  both  to  devel¬ 
op  valuation  models  and  to  test  the  accuracy  of  value  estimates. 
Two  points  about  this  issue  are  worth  special  emphasis.  First, 
testing  against  the  same  year's  data  does  not  imply  some  kind  of 
"cooking",  associated  with  the  direct  substitution  of  actual 
sale  prices  for  estimates  of  market  value.  Second,  testing 
against  data  from  some  subsequent  time  period  likely  raises  at 
least  as  many  problems  as  those  it  might  be  thought  to  resolve. 
For  example,  it  is  difficult  to  tell  whether  discrepancies  be¬ 
tween  value  estimates  and  actual  sale  prices  reflect  inaccura¬ 
cies  in  valuation  methods,  or  general  changes  in  property  values 
from  one  time  period  to  another. 


Test  1.  Figure  3  presents  two  different  kinds  of  "accuracy  test" 
both  based  on  1969  sales  data.  The  first  is  a  simple  classifi¬ 
cation  of  percentage  deviations  between  estimated  market  values 
and  actual  sale  prices.  To  illustrate,  if  the  estimated  market 
value  for  a  particular  property  is  $25,000  and  the  actual  sale 
price  is  $20,00Q,  the  percentage  deviation  is: 

$25,000  -  $20,000  x  10Q%  _  +25%. 

$20,000 

Tables  of  percentage  deviation  for  each  of  the  10  valuation  mod¬ 
els  from  Figure  2  are  set  out  in  Figure  3  under  the  heading  "Test 
1".  Naturally,  a  valuation  model  where  80%  of  estimated  market 
values  are  within  +  10%  of  actual  price  is  more  accurate  than  a 
model  where  only  60%  of  estimated  values  are  within  +10%  of  ac¬ 
tual  price. 


Test  2.  The  second  test  presented  in  Figure  3  is  the  "coeffi¬ 
cient  of  dispersion".  Since  procedures  for  calculating  this 
measure  are  outlined  in  standard  assessment  literature,  they  are 
not  dealt  with  in  this  report. 23  It  is  worth  noting,  however, 
that  the  coefficient  of  dispersion  is  both  a  somewhat  unstable 
guide  to  assessment  quality,  and  difficult  to  interpret  in  any 
simple,  concrete  way. 24  jn  this  context,  the  coefficient  of  dis¬ 
persion  is  presented  in  Figure  3  not  because  of  its  intrinsic 
merits,  but  because  it  appears  to  be  the  only  index  of  quality 
which  currently  enjoys  a  degree  of  recognition  within  the  assess- 
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ment  community  as  a  whole. 


25 


Results .  If  the  results  of  the  tests  set  out  in  Figure  3  are 
combined,  77%  of  the  value  estimates  produced  by  all  10  valua¬ 
tion  models  taken  together  are  within  +10%  of  sale  price,  and 
the  overall  coefficient  of  dispersion  is  7. 18%. 27  if  the  tests 
for  each  model  are  considered  separately,  Figure  3  clearly  in¬ 
dicates  that  some  valuation  models  are  more  accurate  than  others 
Broadly  speaking,  models  for  newer  houses  are  more  accurate  than 
models  for  older  houses,  and  in  most  cases  models  for  small  to 
middle  size  houses  are  more  accurate  than  models  for  larger 
houses . 

There  seem  to  be  two  possible  explanations  for  these  variations 
in  accuracy  among  valuation  models.  First,  the  property  groups 
associated  with  less  accurate  models  (especially  older  houses) 
might  involve  important  characteristics  that  are  not  included  in 
the  37  characteristics  for  which  data  was  initially  collected. 
Second,  relationships  between  sale  price  and  property  character¬ 
istics  might  be  less  regular  for  groups  associated  with  less  ac¬ 
curate  models  than  for  other  groups,  as  a  result  of  "intrinsic" 
imperfections  in  real  property  markets.  To  the  extent  that  the 
first  explanation  is  true,  less  accurate  models  might  be  improv¬ 
ed  by  collecting  additional  data.  To  the  extent  that  the  second 
explanation  is  true,  however,  some  valuation  models  will  always 
be  less  accurate  than  others,  simply  because  some  kinds  of  prop¬ 
erty  are  more  difficult  to  value. 


APPLICATIONS  TO  UNSOLV  PROPERTIES 

Variations  in  accuracy  among  valuation  models  also  have  impli¬ 
cations  for  the  extent  to  which  the  overall  accuracy  associated 
with  tests  of  sold  properties  will  apply  to  properties  that 
have  not  sold.  In  Oshawa  during  1969,  for  example,  when  com¬ 
pared  with  unsold  properties  from  the  same  group,  sold  prop¬ 
erties  tended  to  under  represent  property  groups  associated  with 
less  accurate  valuation  models,  and  to  over  represent  property 
groups  associated  with  more  accurate  valuation  models.  This 
suggests  that  the  overall  accuracy  of  the  10  valuation  models 
indicated  earlier  (77%  within  +10%,  and  7.18%  dispersion)  will 
tend  to  fall  somewhat  when  all  properties  are  taken  into  account 

As  mentioned  before,  to  explore  the  way  in  which  this  issue  in- 
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fluences  the  overall  accuracy  of  value  estimates  for  unsold 
properties,  a  certain  amount  of  data  was  collected  for  all 
single  family  property  in  the  City  of  Oshawa.  The  following 
table  uses  this  data  to  compare  the  percentage  of  "all  prop¬ 
erties"  in  each  of  the  10  property  groups  from  Figure  1  with 
similar  percentages  for  "sold  properties".  The  table  shows, 
for  example,  that  12%  of  all  properties  but  only  8%  of  sold 
properties  are  in  Group  2.  Yet,  Figure  3  indicates  that  the 
valuation  model  associated  with  Group  2  is  the  second  "most 
inaccurate"  of  all  10  models.  On  the  other  hand,  only  2%  of 
all  properties  but  9%  of  sold  properties  are  in  Group  7. 

Yet,  Figure  3  indicates  that  the  model  associated  with  Group 
7  is  the  "most  accurate"  of  all  10  models. 


V1STR1 BUTION  OF  PROPERTIES  Jhl  OSHAUV A  8^  PRO¬ 
PERTY  GROUPS ,  7  9  6  9 


1969 

Residential 

Property 

Groups 

All  Properties 

Sold  Properties 

Number 

Percent 

Number 

Percent 

1 

1725 

11 

162 

11 

2 

1848 

12 

118 

8 

3 

1621 

10 

106 

7 

4 

1859 

12 

92 

6 

5 

3559 

23 

167 

11 

6 

1827 

12 

129 

9 

7 

259 

2 

141 

9 

8 

1288 

8 

153 

10 

9 

781 

5 

114 

8 

10 

861 

5 

324 

21 

Total 

15628 

100 

1506 

100 

If  all  models  taken  together  were  applied  to  all  properties, 
it  seems  that  about  72%  of  value  estimates  would  be  within 
+10%  of  actual  sale  price,  while  the  coefficient  of  dispersion 
would  be  about  8^%. 28  Although  these  calculations  are  quite 
crude,  they  strongly  suggest  that  in  terms  of  currently  ac¬ 
cepted  "standards  of  excellence"  the  mass  market  approach  out¬ 
lined  in  this  report  can  produce  acceptable  assessment  valua- 
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tions.  At  the  same  time,  no  clear  judqement  about  the  util¬ 
ity  of  this  approach  in  property  tax  assessment  is  possible 
until  the  techniques  involved  have  been  evaluated  under  prac¬ 
tical  field  conditions.  In  this  sense  the  work  presented  here 
can  be  viewed  as  a  "technical"  basis  for  more  detailed  studies 
of  problems  in  implementation  and  administration. 
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Annual  International  Conference  on  Assessment  Administra¬ 
tion  (Chicago ,  1968)  ,  26-39  . 

2.  Paul  Wendt,  Real  Estate  Appraisal  (New  York,  1956),  280. 

3.  It  is  widely  recognized,  of  course,  that  prices  assoc¬ 
iated  with  "invalid"  sales  do  not  accurately  reflect 
property  value,  and  should  be  excluded  from  valuation 
work.  See,  e.g..  Appraisal  Institute  of  Canada,  Real 
Estate  Appraising  in  Canada  (Winnipeg,  1970),  245-246; 
American  Institute  of  Real  Estate  Appraisers,  The  Apprais¬ 
al  of  Real  Estate  (Chicago,  1967),  338-343;  Sanders  A. 

Cahn,  Frederick  E.  Case,  and  Alfred  Schimmel,  Real  Estate 
Appraisal  and  Investment  (New  York,  1963),  90-93;  and 
Angus  N.  MacKay,  Appraisal  Notes  for  the  Assessor  (Toronto, 
1968) ,  32-35 . 

4.  Typical  factors  that  contribute  to  imperfections  in  real 
property  markets  are  "the  basic  nonhomogeneity  of  real 
estate",  and  inadequate  market  organization  leading  to 
poor  communications  among  buyers  and  sellers.  See,  e.g., 
Wendt,  Real  Estate  Appraisal,  254-255. 

5.  This  point  of  view  has  been  most  closely  associated  with 
the  work  of  Richard  Ratcliff.  See,  e.g.,  Modern  Real  Es¬ 
tate  Valuation  (Madison,  Wise.,  1965) ,  Ch .  Ill;  and  "Mar¬ 
ket  Value  Cannot  Be  Estimated",  The  Real  Estate  Apprais¬ 
er  ,  January-February  1970,  16-19. 

6.  See,  e.g.,  Wendt,  Real  Estate  Appraisal,  265-267. 

7 .  Ibid . ,  266  . 

By  convention,  of  course,  adjustments  are  also  made  for 
"non-property  characteristics"  (like  time  of  sale  and  finan¬ 
cing  arrangements)  that  have  an  important  influence  on  mar¬ 
ket  value.  See  references  cited  in  note  3. 
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9.  See,  e.g.,  Appraisal  Institute  of  Canada,  Real  Estate 
Appraising,  249-251;  and  American  Institute,  The  Ap¬ 
praisal  of  Real  Estate,  345-347.  For  an  interesting 
attempt  to  resolve  some  of  the  problems  associated  with 
price  adjustments  in  the  traditional  market  approach  see 
Richard  Ratcliff  and  Dennis  Swan,  "Getting  More  From 
Comparables  by  Rating  and  Regression",  The  Appraisal 
Journal ,  January  1972,  68-75. 

10.  As  in  the  traditional  market  approach,  accepted  proced¬ 
ures  are  followed  with  regard  to  matters  like  "invalid 
sales"  and  financing  arrangements  (see  notes  3.  and  8.) 
Similarly,  see  Figure  2  (p.  8)  for  examples  of  differ¬ 
ences  in  value  associated  with  time  of  sale. 

11.  This  minimum  group  size  of  100  sales  is  somewhat  arbi¬ 
trary,  but  if  anything  seems  more  than  adequate  both 
in  terms  of  the  theory  behind  multiple  regression  ana¬ 
lysis,  and  in  terms  of  other  reported  uses  of  the  tech¬ 
nique  in  real  property  valuation.  See,  e.g.,  Fred  E. 
Case,  "New  Decision  Tools  for  Appraisers",  Appraisal 
Journal ,  January  1967,  21-27;  and  Robert  A.  Blettner, 
"Mass  Appraisal  Via  Multiple  Regression  Analysis", 
Appraisal  Journal,  October  1969,  513-521. 

12.  See  John  Fruend ,  Modern  Elementary  Statistics  (Engle¬ 
wood  cliffs,  N.J.,  1967),  Ch .  14,  for  a  simple  outline 
of  the  principles  of  regression  analysis;  and  Norman 
Draper  and  H.  Smith,  Applied  Regression  Analysis  (New 
York,  1966) ,  for  a  more  complete  discussion  of  the 
actual  procedures  associated  with  regression  techniques. 

13.  It  is  important  to  note  that  "place"  does  not  neces¬ 
sarily  mean  "municipality".  As  indicated  in  the  text 
(p.  5),  each  valuation  index  requires  about  100  sales. 
Consequently,  within  the  confines  of  common  sense  and 
dependable  local  knowledge,  "place"  is  defined  so  as 
to  generate  a  sufficient  number  of  sales  for  effective 
analysis . 

14.  The  following  table  classifies  the  various  reasons 
for  excluding  certain  sales  from  analysis: 
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NUMBER  OF  PROPERTIES  EXCLUVEV  FROM  OSHAULA  ANALYSIS 


Properties  with  Data  Collection  Errors.... . 26 

Properties  with  Unusual  Characteristics. . ...21 


Period  I:  Floor  Area  Over  2500  sq.  ft.... .3 
Period  II:  Floor  Area  Over  2000  sq.  ft.... 2 
Period  III:  Floor  Area  Over  2400  sq.  ft... 2 

Two  Storey  Houses  with  Floor 


Area  Under  1200  sq.  ft........ 3 

Houses  with  Less  Than  One  Bathroom . ..11 

Total  Number  of  Properties  Excluded  ......  47 

Number  of  Properties  Included  in 
_  Analysis . .  1506 


(Periods  I-III  relate  to  building  age  in  Figure  1,  p.  6. 

15 .  The  following  table  sets  out  the  property  characteristics 
for  which  data  on  sold  properties  was  collected: 


SINGLE  FAMILY  CHARACTER!  STL  CS ,  S0LV  PROPERTIES,  OSH  AIL  A  , 

1969 


TRANSACTION  CHARACTERISTICS  SITE  CHARACTERISTICS 

1.  Total  Sale  Price  (Dollars)  3.  Frontage  (Feet) 

2.  Date  of  Sale  (Months)  4.  Depth  (Feet) 

BUILDING  CHARACTERISTICS 


5. 

Floor  Area 

15. 

Structure : Sol id  Brick 

6  . 

Building  Age 

16  . 

Concrete , Stone 

7  . 

Rooms 

17  . 

Brick  Veneer 

8  . 

Bedrooms 

18  . 

Wood 

9  . 

Design : Semi-Detached 

19  . 

Garage:  No  Garage 

10. 

Split-Level 

20  . 

Carport 

11. 

Bungalow 

21. 

Single  Garage 

12. 

lh  Storey 

22  . 

Double  Garage 

13. 

2  Storey 

23  . 

Bathrooms : One  Bathroom 

14  . 

More  than  2 

24  . 

1%  Bathrooms 

Storey 

25. 

2  or  More  Bath 

rooms 

(Table  Continued) 
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(Table  Continued) 


LOCATIONAL  CHARACTERISTIC 
Neighbourhoods  1  to  13,  Variables  26  to  38 


"Neighbourhoods"  are  defined  as  geographic  areas 
within  which  locational  advantage  is  felt  to  be  relatively 
homogeneous.  The  neighbourhood  boundaries  shown  on  the 
following  map  of  Oshawa  were  developed  through  consultation 
with  local  assessment  staff  and  extensive  field  surveys. 


OSHAWA  WEIGH  SOU  IRH0ODS 

16.  The  following  table  sets  out  the  property  characteris¬ 
tics  for  which  data  on  all  properties  were  collected: 


SINGLE  FAMILY  CHARACTERISTICS,  ALL  PROPERTIES,  OSH AM A , 

19  69 


1. 

Site 

Frontage 

4  . 

Building 

Age 

2. 

Site 

Depth 

5  . 

Building 

Design : 

Detached 

3  . 

Total 

Floor  Area 

6  . 

Semi  Detached 
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17. 


Description  of  these  techniques  is  beyond  the  scope  of 
this  report.  Persons  who  wish  more  information  should 
consult  Harry  H.  Harman,  Modern  Factor  Analysis  (Chicago, 
1967) ;  and  John  Sonquist  and  James  Morgan,  The  Detection 
of  Interaction  Effects  (Ann  Arbor,  Mich.,  1964)  . 

18.  in  mild  defiance  of  an  old  convention  we  treat  semi¬ 
detached  houses  as  single- family  rather  than  multi-family 
dwellings,  and  consequently  they  fall  within  the  scope  of 
our  current  work.  This  raises  a  minor  but  interesting 
point  concerning  the  influence  of  valuation  methods  on 
assessment  terminology.  From  the  standpoint  of  construc¬ 
tion  cost  it  makes  sense  to  treat  semi-detached  houses  as 
multi-family  dwellings,  since  the  entity  actually  con¬ 
structed  is  a  dwelling  unit  for  two  families.  From  the 
standpoint  of  market  analysis,  however,  it  makes  more 
sense  to  treat  semi-detached  houses  as  single-family  dwel¬ 
lings,  since  the  entity  typically  exchanged  "on  the  market" 
is  a  dwelling  unit  for  one  family. 

19.  See,  e.g.,  Appraisal  Institute  of  Canada,  Real  Estate  Ap¬ 
praising  ,  246-247. 

20.  See  note  13. 

21.  it  is  worth  emphasizing  that  even  where  the  tradional  "cost 
approach"  to  assessment  valuation  is  used,  special  atten¬ 
tion  is  required  for  unusual  residential  properties. 

22.  See,  e.g.,  Jack  Lessinger,  "Econometrics  and  Appraisal", 

The  Appraisal  Journal,  October  1969,  501-502. 

23.  See,  e.g.,  Frederick  Bird,  The  General  Property  Tax;  Find- 
ings  of  the  1957  Census  of  Governments  (Chicago,  1960), 

Ch.  6  . 

24.  See,  e.g.,  Dick  Netzer,  Economics  of  the  Property  Tax  (Wash 
ington,  1966),  177-182. 

2  5 .  Ibid . 

26.  See,  e.g.,  Robert  Craig,  "Property  Assessment  at  Market 
Value",  Appraisal  Institute  Magazine,  Winter  1970-71,  2-16; 
and  John  Rackham,  "Land  Valuation:  A  Priority  Problem  in 
Assessment  Administration",  Assessors  Journal,  October  1969 

3-15. 

27.  The  figure  of+77%  is  derived  by  summing  the  number  of  esti¬ 
mates  within  -10%  from  all  ten  valuation  models,  and  then 
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dividing  by  1506  which  is  the  total  number  of  sales  used 
to  develop  the  models.  The  figure  of  7.18%  is  simply 
the  average  coefficient  of  dispersion  for  all  ten  models, 
weighted  by  the  number  of  sales  in  each  case. 

28.  The  following  sets  out  the  method  used  to  derive  these 
two  figures: 

ACCURACY  OF  VALUATIONS  FOR  ALL  PROPERTIES  IN 

OSH AW  A ,  1969 


1969 

Residential 

Property 

Groupings 

Sold 

Properties 

All  Pr 

operties 

%  Between 
+10%  De¬ 
viation* 

(1) 

Number 

(2) 

No . Between 
+10%  De¬ 
viation 
(1)  X  (2) 

1. 

53 

1725 

914 

2  . 

54 

1848 

998 

3. 

68 

1621 

1102 

4  . 

59 

1859 

1097 

5. 

80 

3559 

2847 

6  . 

85 

1827 

1553 

7. 

97 

259 

251 

8. 

81 

1288 

1043 

9  . 

74 

781 

578 

10. 

96 

861 

827 

Total 

15628 

11210 

%  of  Value  Estimates  Between  +10%  of  Actual 
Sale  Price  =  11210  X  100  =  72% 

15628 

Coefficient  of  Dispersion  =  Average  of  the 
Coefficents  of  Dispersion  for  All  Ten  Models, 
Weighted  by  the  Number  of  Properties  in  Each 
Group  =  8.57% 


*  These  figures  are  taken  from  Figure  3,  p.ll. 
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